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SHADING AND TEXTURING 3 -DIMENSIONAL COMPUTER GENERATED 

IMAGES 

This invention relates to a method and apparatus for 
5 shading and texturing 3-dimensionai computer generated 

images . 

The standard method used when generating 3- 
dimensional images for shading and texturing is the z or 
depth buffer system. This has been in use for many years 

10 and is now an industry standard. 

In our British Patent No. 2281682, we have proposed 
an alternative method with many advantages over the z 
buffer system.- It is a ray casting technique in which 
each object (polygon) in an image is defined by a set of 

15 infinite surfaces which are tagged as forward or reverse 

facing. A ray from a viewpoint is cast into the scene and 
intersections with the surfaces are determined along with 
the distance of the intersections from an image plane. By 
analysing this data, it is possible to determine which 

20 surface of each polygon is visible for each pixel and thus 

it is possible to shade and texture the pixel. The 
technique may be implemented by using a pipeline of 
processing elements, each of which can perform a ray 
surface interception calculation to determine the depth 

25 value for that surface for each pixel in turn. When the 
depth value for a surface at a pixel has been determined, 
using these processing elements it is stored in a depth or 
z buffer with data identifying the surface. The z buffer 
information can then be read out and used by a texturing 

30 device to apply texture data for display via a frame 
store . 

Surfaces in the system can be opaque or they may have 
transiucency . Blending values can be associated with the 
surfaces to enable transiucency effects to be displayed. 
35 For example, a cloud may be modelled as a translucent 

surface by assigning the RGB values to define its colour 
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and an alpha blending value to define ins transiucency. 
The degree of transiucency is controlled by modulating the 
alpha value of the nexiure map across the surface. A 
commonly used blending mode is known as alpha blending 
5 where successive polygons are blended into the frame 

buffer and put into the equation: 

RGB ( new) = alpha *RG3 ( frame . buff er ) + ( 1-alpha ) *RGB (texture) 

This technique is well known. A restriction when 
using alpha blending is, that in order to render a 
10 correctly blended image, the pixels which display the 

polygons must .be presented to the blending unit in depth 
order rendered from back to front so that each contribute 
the correct amount for the final image. For a z buffer 
system; this ordering is typically performed by the 
15 application software that is feeding the z buffer. This 

is referred to as pre-sort mode. The ray casting 
technique can use either the pre-sort mode or an automatic 
pixel accurate type of sort. 

There is a special case of translucent texture 
20 referred to as "punch through". This is defined as a 

translucent texture where the alpha component is 
restricted to be either M on", i.e., fully transparent, or 
"off", i.e., fully opaque. This type of texture is very 
common in 3-D game applications for two reasons; firstly 
25 it allows complex scenes like forests to be modelled using 
relatively few polygons; and, secondly, a traditional z 
buffer can correctly render punch through transiucency 
irrespective of the order in which polygons are presented 
to the system. 

30 A traditional z buffer pipeline with alpha testing 

for transiucency is shown in Figure 1. In this, polygons 
to be rendered are first scan line converted in the 
polygon scan converter 2 and the resulting x,y,z,u,v,w 
values are then fed to the texturing unit and to the depth 

25 test unit (the z buffer) . Texture addresses are sent to 
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texture memory. Texture values retrieved from texture 
memory pass to a texture filter 4 which reduces aliasing 
artifacts introduced by the texture resampling process. 
The filtered values are passed to a texture blend unit 6 
5 which blends the texture values with the base colour and 
highlights of the polygon. Next, an alpha test is 
performed on the alpha component of the resulting pixel in 
an alpha test unit 8. The test is against a reference 
alpha value . 

10 The alpha test unit performs a magnitude comparison 

with an alpha reference value. The user supplies the 
alpha reference value, and a compare mode which is one of 
"never", "less", "equal", "less or equal", "greater", "not 
equal", "greater or equal", or "always". The test 

15 selected depends on the type of image the user is 

creating. The alpha test unit outputs whether or not the 
compare mode has been passed or failed by the input alpha 
value . 

If the result of the alpha test is a pass then the 

20 depth test is performed on the z value and RGB values in 

the z buffer updated. If the test is failed, then no 
further processing of pixels takes place. Thus, in the 
typical case where the reference alpha is one and the test 
is greater than or equal, then only opaque pixels are 

25 written to the frame buffer, and these pixels are depth 

tested against all other polygons in the scene, 
irrespective of the order in which polygons are processed. 
The depth test is performed by a depth test unit 10 which 
reads z values from the z buffer 12 via a stencil unit 14 

30 and is able to write the z values directly to the z buffer 

store. The depth test conditions are shown in Figure 1 
next to the depth test unit. 

Figure 2 shows the' ray casting technique of our 
British Patent No. 2281682 with deferred texturing, that 

35 is to say, texturing data is applied at the end of the 

ray/surface intersection testing process. The apparatus 
comprises a polygon setup unit which provides data which 
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defines the plane equations cf the polygons. This data is 
then fed to an array of processing elements 22, each of 
which is able to perfcrm one ray/surface intersection test 
and can produce a depth value for that ray/surface 
t intersection. Typically, the processing array operates on 

a sub-set cf the whole image known as a "tile" which is 
e.g., 32 x 32 pixels and operates on one polygon at a 
time. The depth values computed are stored in a tile 
depth store 24 . 

ic Depth and surface values from the tile depth store 

are applied to a parallel runlength encoder 26. This then 
provides an output to the texturing unit via an XY address 
for a pixel which is fed to a polygon scan conversion unit 
28 and a tag which goes to the polygon setup unit 30. 

is This calculates the plane equations for the texturing and 

shading, and recalculates the plane equations of the 
polygons . 

This setup unit receives the polygon texture data and 
then provides data to the polygon scan conversion unit 28. 

20 The RGB values and alpha values and highlights applied to 

a surface are then sent to a texture blending unit 32 
where they are combined with RGB and alpha values from 
texture memory via a filter 24 and are then passed to the 
tile accumulation buffer from where they will be sent to 

25 the main frame store for the image. 

The advantage of deferring texturing until all the 
ray/surface intersections have been performed is that 
texture and shading operations then only occur on visible 
pixels. Thus, effective fill rate is increased by the 

30 ratio of occluded to visible pixels in the scene. By 

definition, in a deferred texturing pipeline the depth 
test occurs before the texturing takes place and, 
therefore, also takes place before the alpha test. As a 
result, it is not possible to correctly render the punch 

25 through textured polygons unless they are either presented 

in back to front order and are non-overlapping, or they 
are subject to a pixel accurate pre-sorting operation 
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earlier in the pipeline. The first cf these arrangements 
imposes an unnecessary restriction in the software driver. 
The second requires an unnecessary processing overhead. 

We have appreciated that by including a feedback loop 
to the depth store from the results cf the alpha test for 
each pixel and deferring the updating cf the depth store 
until the results of the alpha test for each pixel are 
known this problem may be overcome. This requires both 
feedback from the alpha testing to the depth testing and 
feedforward from the depth test unit to the alpha blending 
unit . 

Using this idea enables four standard modes of 
operation to be used as follows: 

1. A standard z buffer no-sort, punch through 

15 compatibility mode ; 

2. An enhanced punch through mode with no-sort and 

deferred operation; 

3. An enhanced punch through mode with auto- 
sorting surfaces and deferred operation; 

20 4. Generalised auto-sort alpha blend mode. 

These modes of operation and preferred embodiments of 
the invention will now be described in detail by way of 
example with reference to the accompanying drawings in 
which : 

25 Figure 1 is the prior art z buffer system described 

above ; 

Figure 2 is the prior art ray casting system with 
deferred texturing; 

Figure 3 is an embodiment of the present invention; 
30 Figure 4 is a further preferred embodiment of the 

invention with an auto-sort unit; 

Figure 5 shows schematically the auto-sort scheme for 

polygons ; and 

Figure 6 shows schematically a further auto-sort 

35 scheme for polygons. 
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The block diagram of Figure 3 is a modification of 
that of Figure 2 in accordance with an embodiment: of the 
invention . 

As in Figure 2, a polygon setup block 20 receives 
5 polygon vertex data before supplying polygon surface data 

to the processor element array 22 which computes the 
depths of each surface at each pixel and stores them. 
This also includes a depth tester to determine the closest 
surface to the image plane for each pixel . This can 

10 supply the standard ABC and tag parameters which are used 

to define each surface to a bypass FIFO store 40. This in 
turn can supply those parameters back to the processor 
element array -22 when controlled so to do. 

XY address data and tag data is supplied by the 

15 parallel runlength encoder 26 to the polygon setup- unit 30 

and the polygon scan converter 28 in a similar manner to 
Figure 2. The polygon setup unit receives polygon texture 
data from the texture store. The blending unit 32 and 
filter 34 operate in a similar manner to that of Figure 2. 

20 However, after the texture blending unit, an alpha test 

unit 42 is provided. This has a pass/fail output which is 
used as a control to a punch through control block 44 
which also receives an alpha value and position data from 
the alpha test unit. The alpha test unit has an output to 

25 a conditional blend unit 46 which can blend the textured 

data directly with data from the tile depth store 24 
before supplying the data to the tile accumulation buffer 
36. 

There is also an auto sort unit, for surface data, 
30 connected to the tile depth store. This sends data to a 

vertex requester 50 which then ensures that polygon vertex 
data is supplied in an appropriate order to the polygon 
setup unit 20. 

It has a sort direction control so that it can sort 
35 surfaces from front to back and from back to front and 

also a bypass control to inhibit its use. Use cf the 
circuitry will be described in four different modes. 
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The z buffer is such a widely used rendering 
algorithm that it is useful :c have a mode of operation 
which emulates this since this is schematically what many 
programmers will be familiar with. Thus, the advantages 
5 of the ray casting rendering algorithm are obtained while 

appearing to be operating in a z buffer mode . 

In this mode, polygons bypass the auto sort logic 48 
as a result of a control .signal sent to its bypass input. 
Instead, they pass to the depth test unit associated with 

10 tile depth store 24 unsorted. Rather than perform the 

depth calculation at this point, the standard ABC and tag 
parameters which form the basis of the ray casting 
technique are -stored in the bypass FIFO 40 and the screen 
XY locations and tag values are forwarded to the deferred 

15 texturing unit for each surface in turn. 

In this mode of operation texturing is not deferred, 
as all pixels are presented to the texture unit regardless 
of whether they have been occluded by a previously 
rendered opaque pixel which is closer to the eyepoint in 

20 the current pixel. The texture unit processes "texels" 

(texture elements) in the order in which they are 
presented. Texels are filtered, blended with the polygon 
base colour, and any highlights, and are alpha tested in 
the same way as for a traditional z buffer (see Figure 1). 

25 For each pixel, if the alpha test is passed, the 

corresponding depth is calculated from the stored ABC and 
tag parameters in FIFO 40 which are fed back to the 
processor element array 22 and then into the tile depth 
store 24. The corresponding depth is then calculated with 

30 the associated depth test unit and the tile depth store is 

updated. The pixel RGB value is then blended into the 
tile accumulation buffer by the conditional alpha blend 
unit 46. This process continues until all the polygons in 
the scene have been processed. The speed of operation of 

35 this is equivalent to a standard z buffer since all the 
polygons have to be" textured and shaded. There are no 
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economies no be made by only texturing and shading the 
visible polygons. 

The second mode of operation is one in which punch 
through control is used to speed up processing but there 
5 is no sorting of polygons and surface data prior to 

shading and texturing. The mode is the same as that 
described for 2 buffer operation with the exception that 
the polygons are depth tested against the current contents 
of the tile depth store before being passed to the 
. 10 texturing unit. Punch through textures are detected by 

the alpha test unit 42 which sends signals to punch 
through control unit 44 to send the punch through surfaces 
back to the processor element array 22. They are then 
sent to the tile depth store and depth test unit 26 which 

15 tests them against the current contents of the store. If 

they are closer to the image plane then they replace the 
current contents. If a succeeding polygon or a part of a 
polygon is occluded at a particular pixel by a previously 
rendered opaque pixel, then it is not sent to the 

20 texturing unit. Thus, the degree of fill rate improvement 

over the 2 buffer system will depend on two factors; 
firstly, the order in which the polygons are presented; 
and, secondly, the latency between the depth test and the 
alpha test. For example, if polygons happen to be 

25 presented in a back to front order and the polygons are 

non-overlapping, the fill rate will be identical to the 2 
buffer system. If, on the other hand, the polygons happen 
to be presented in front to back order, in a 0 latency 
system, the fill rate requirement will be reduced by the 

30 ratio of ideal occluded pixels in the scene to visible 

pixels in the scene, (i.e., the depth complexity). The 
effect of latency in the system is to reduce the 
efficiency of this process, since for a finite time window 
(the degree of latency in the system) , a proportion of 

35 pixels which could have been identified as occluded in a 0 
latency system will be passed to texturing unit and will 
consume texturing bandwidth. This latency is inherently 



SUBSTITUTE SHEET (RULE 26) 



WO 00/28482 ™ W PCT/GB99/03706 



15 



because there is a time period which will be taken to 
texture the first polygon to pass through the texturing 
unit and alpha and depth test it. Once this initial 
latency has been overcome, the processor element 
5 arrangement and the tile depth store and depth test unit 

24 will be provided with depths for new polygons and 
performing depth tests on previously rendered polygons 
when the result of the alpha test is that the pixel in 
question is a punch through pixel occluding other pixels 

10 in the scene. 

A third mode of operation is a deferred texturing 
pipeline process which uses a transiucency sorting 
algorithm. 

As described above, the degree of fill rate 
improvement provided by the invention depends on the order 
in which the polygons are presented. The advantage of 
using punch through control in combination with pixel 
accurate auto sorting is such that a system can ensure 
that polygons and parts of polygons are always processed 
in optimal order. The auto sort algorithm for punch 
through processing differs from the algorithm for alpha 
blend processing in two key respects. Firstly, the punch 
through pixels are sorted from front to back rather than 
back to front. This is because if there is a punch 
25 through pixel, it will have an alpha value of 1 and no 

surfaces behind that will contribute to the shade and 
texture applied to that pixel. Secondly, the sorting 
overhead can be reduced by decomposing the sort list into 
smaller chunks. We shall refer to this as "chunking". 
30 we shall describe the operation of punch through auto 

sort algorithms with reference to Figure 4. This shows 
the portion of Figures 2 and 3 which performs the ray 
casting algorithm but does not show the texturing 
hardware . 

35 As can be seen, a cache memory 52 is provided between 

the polygon setup unit 20 and the processing element array 
22. The tile depth store and depth test unit 24 has an 
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output to Auto Sort logic 54 which is coupled to auto 
discard logic 55 and chunking logic 54 . The chunking 
logic has an output back to the cache 52 and also to 
vertex requester unit 50. The Auto Sort logic 56 
5 comprises at least one additional tile depth store for 

temporary storage of data. When iooking for opaque 
surfaces these are not required as a comparison with the 
currently stored depth determines whether or not an opaque 
pixel is closer than the current depth. They are used 
10 when sorting translucent objects. These additional depth 

stores could be provided in the tile depth store and depth 
test unit 24 . 

3ecause punch through textures are typically used to 
model complex structures such as forests and cloud scenes, 
15 the number of polygons used for punch through is generally 

much greater than that used for alpha blended 
translucency . Consequently, the processing overhead for 
sorting has to be minimised to make the system efficient. 
A simple algorithm to sort n object into a oscending or 
20 descending order would require n 2 operations. This is 

illustrated in Figure 5 in which a tree punch through 
texture can be seen on the front surface, which has opaque 
texels in the region of the tree and transparent ones 
around it. Auto sorting is performed by rendering all of 
25 the translucent polygons in order to recognise the bottom 
layer. Therefore, the number of polygons per tile 
processed is the number of polygons multiplied by the 
number of layers which is 2n 2 . 

If each object selected is discarded from the sorting 
30 operation, the number of operations is 

n+n-1 + n-2 + +1 

which is approximately equal to n 2 /2 . The characteristic 
of punch through sorting is that the sort can be chunked 
without introducing any visual errors. For chunking, the 
35 number of operations is MOD (n/m) *m : -i-REM (n/m) 2 , where n is 
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the chunk size. Reducing the chunk size reduces both the 
sorting overhead and the efficiency of the sort. Any real 
implementation of this algorithm will be a trade-off 
between the computing resource available used in the sort 
5 algorithm and the efficiency of the punch through 

operation. The benefit of chunking is that it increases 
the degree of freedom within which this trade-off can be 
explored. The sorting algorithm can be further optimised 
unless it can terminate early, at the point at which all 
10 the pixels in a tile have become validated (i.e., they 
have been assigned a valid opaque depth) . This is 
illustrated with reference to Figure 6. In tile (a) the 
nearest polygon hides all polygons behind it. Therefore, 
the number of polygons processed to n. 
15 A single pass through the punch through sorting 

algorithm will find the closest polygon to the image plane 
for each pixel. Then, in the case of tile (a), the first 
pass will determine that a closest opaque polygon has been 
found for each pixel in the tile, and therefore no further 
20 passes are necessary. 

Chunks of polygon data are supplied to the tile depth 
store, depth test logic and auto sort logic by the 
chunking logic 54 . They then provide into the discard 
logic polygons which are no longer required. 
25 The auto sort logic then sorts the polygons to be 

rendered in a direction controlled by a sort direction 
input and supplies them to cache memory 52 from where they 
can then be sent again to the processor element array 22 
and eventually on through to the texturing unit. Thus, 
30 the auto sort logic sorts the polygons into front to back 

order and when used in the apparatus of Figure 3, is able 
to significantly reduce the processing overhead in complex 
scenes, since the closest fully opaque pixels will be 
processed first and polygons behind these will not need to 
35 be textured. 

The* fourth mode of operation of the "circuit of Figure 
3 is a generalised auto sort alpha blend mode. 
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With state of the art graphic controllers performing 
bi-linear and tri-Iinear texturing as standard operations, 
the blocky visual nature of punch through textures is 
becoming less acceptable. Typical art work, for say, a 
5 tree texture would be punch through (i.e., fully opaque) 

in the body of the tree and alpha blended (i.e., partially 
translucent) of the extremities of the leaves. It is 
possible with the circuit of Figure 3 to correctly render 
this type of alpha blended texture whilst still retaining 
io the benefit -of deferred texturing. 

In order to do this, two passes through the tree 
surface data would be made. In the first pass, the punch 
through portion of each polygon in a tile is processed as 
described in the auto sort mode above. The alpha test 
15 unit 42 is set to pass only fully opaque texels, so that 

at the end of the pass the tile depth buffer contains the 
depth of the closest fully opaque texel to the eye for 
each pixel position in the tile. In the second pass, the 
auto sort algorithm sorts the pixels from back to front, 
20 and the depth test is set to "greater than" so that for 

each visible polygon fraction, only the non-opaque (i.e., 
the alpha blended fringe of the leaves in the tree 
example) is passed to the texturing unit. Because the 
second pass sorts back to front, any overlapping partially 
25 translucent textures will be correctly blended. The 

second pass should be very efficient because in a typical 
scene, (i.e., a punch through forest) only a small 
percentage of the total pixels in the polygon list will 
pass the depth test. The suitability of this technique 
30 for general alpha blended textures depends on the 

proportion of opaque texels to translucent texels in the 
texture maps. In the tree example, the algorithm would be 
most suitable. If, however, all the textures were clouds 
and contained no opaque pixels, then standard auto sorting 
35 would be the preferred method. 

It will therefore be appreciated from the above that 
methods and apparatus which operate according to the ray 
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casting technique for rendering 3-dimensional images can 
be modified to obtain the benefit of reduced processing 
overheads from punch through textures, thus speeding up 
the operation of the system. The use of the punch through 
5 textures is particularly beneficial in scenes where there 
are a large number of overlapping punch through textures 
such as cloud scenes or forests. The use of the punch 
through processing means that only the polygon closest to 
the viewpoint for each pixel has to have a texture value 

10 applied to it. Without this operation it would be 

necessary to apply textures to all the polygons which 
intercept the ray which passes through that pixel. In a 
scene such as a forest, this could easily lead to several 
thousand texturing operations being required for each 

15 pixel instead of one. Thus, very complex scenes can be 
textured at much higher speeds than would otherwise be 
possible . 
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CLAIMS 

1. A method for shading and texturing 3- 
dimensional computer generated images comprising the steps 
of: 

5 supplying data defining a group of surfaces 

representing each object in the image in turn; 

for each elementary area of the display, 
generating a depth value for each surface of each object 
in dependence on the distance of that surface from an 
10 image plane; 

applying shading and texture data to the 

surfaces; 

determining whether any texture data applied to 

a surface is fully opaque; 
15 storing the depth values for opaque textures of 

objects at elementary areas in a depth testing means; 

comparing the depth of surfaces from subsequent 

objects with the depth values for the opaque objects at 

elementary areas; and 
20 discarding the surfaces of the subsequent objects for 

elementary areas which already have a fully opaque surface 

closer to the image plane. 

2. A method according to claim 1 in which the 
objects in an image are first sorted from front to back 

25 such that any fully opaque objects inhibit texturing of 

objects behind them. 

3. A method according to claim 1 in which at least 
one texture includes fully opaque portions and translucent 
portions and wherein the objects in the image are first 

30 sorted from front to back and the fully opaque elements 

are used to inhibit texturing of objects behind them, and 
the objects are then sorted from back to front and any 
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non-opaque elementary areas have texturing applied to 
them. 

4. A method according to any preceding claim 
including the set of first dividing the image with a 

5 plurality of rectangular areas and shading and texturing 
each rectangular area in turn. 

5. Apparatus for shading and texturing a 3- 
dimensional computer generated image comprising: 

means for suppling data defining a group of 
10 surfaces representing each object in the image in turn; 

means for generating a depth value for each 
surface of each object at each elementary area of the 
display in dependence on the distance of that surface from 
an image plane; 

15 means for applying shading and texture data to 

the surfaces; 

means for determining whether any texture data 
applied to a surface is fully opaque; 

means for storing the depth value for opaque 
20 textures of objects at elementary areas in a depth testing 

means ; 

means for comparing the depth surfaces from 
subsequent objects with the depth values for the opaque 
objects at each elementary area; and 
25 means for discarding the surfaces of the 

subsequent objects for elementary areas which already have 
a fully opaque surface closer to the image plane. 

6. Apparatus according to claim 5 including means 
for sorting the objects in the image from front to back 

30 such that fully opaque objects inhibit texturing of 

objects behind them. 

7 . * Apparatus according to claim 5 in which at 
least one texture includes fully opaque portions and 



SUBSTITUTE SHEET (RULE 26) 



WO 00/28482 




PCT/GB99/03706 



- 16 - 

translucent portions and including means for first sorting 
the objects in the image from front to back such that the 
fully opaque elements are used to inhibit texturing of 
objects behind them, and for subsequently sorting the 
objects from back to front such that any non-opaque 
elementary areas have texturing applied to them. 

8. Apparatus according to any of claims 5, 6 and 7 
including means for first dividing the image into a 
plurality of rectangular tiles. 
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overlapping, or they are subject to a pixel accurate pre-sorting operation in advance. 
Both arrangements have negative impacts on the software driver or the processing 
means, respectively ( present application, page 4, line 33 to page 5, line 3 ). 

4) . The applicant has recognised that by including a feedback loop to the deepth store 
from the results of the alpha test for each pixel and deferring the updating of the depth 
store until the results of the alpha test for each pixel are known, this disadvantage can 
be overcome ( present application page 5, lines 4 to 8 ). 

5) . This intention is realised by the method according to claim 1 [ and by the apparatus 
according to claim 5 ] by 

- [ means ( 42 ) for ] determining whether any texture data applied to a surface is fully 
opaque; 

- [ said storing means ( 24 ) ] only storing depth values for opaque textures of objects at 
elementary areas; 

- [ means within said storing means ( 24 ) for ] comparing the depth of surfaces from 
subsequent objects with the depth values for the opaque objects at elementary areas 
which already have a fully opaque surface closer to the image plane; and 

- [ means ( 46 ) for ] discarding the surafaces of the susequent objects for elementary 
areas which already have a fully opaque surface close to the image plane. 

6) . For " hidden surface removal " in document D2 pixels which are completely 
covered by opaque objects are resolved in a single pass. When a pixel contains 
portions of two or more triangles, it is " desirable " to merge the pixel fragments so that 
the pixel can be fully composited in one pass ( page 309 right column, lines 4 to 7 ). 

In order to realise this intention in document D2 a method for combining pixel fragments 
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a method is used in which fragments of similar depths are identified and combined if 
their colours are similar. Sine in the architecture of document D2 the colours are not 
available during hidden surface removal, for combining pixel fragments only depth data 
can be used. ( ( page 309 right column, lines 20 to 25 ). 

7) . For improving the performance of an integrated rendering method in D3 ( page 441 
to page 442 first paragraph ) hierarchal adaptive undersampling over a pixel plane is 
used. The image plane is divided into square sample regions, rays are first cast from 
the corner pixels of each sample region, and the intensities of these pixels are 
calculated on the basis of ray-tracing. Then, according to the degree of the similarity of 
the pixel intensities at the four corners of each region, the pixel intensity in the center 
of the region is calculated by using one of two procedures, ray tracing or interpolation. 
This process is hierarchically repeated until the sampling interval over the image plane 
reaches the pixel resolution. 

The algorithm also employs a mechanism for expressing the shapes of polygons that 
may otherwise be partially or completely unvisualised: The intensities of pixels that 
include rasterized lines or points are initially marked, and are never interpolated but 
always ray-traced. 

8) . Since documents D1 to D3 do not address the problem set out in point (4) the 
method claimed in claim 1 and the apparatus claimed in claim 5 are considered to be 
new and nonobvious. 

Therefore independent claims 1 and 5 meet the requirements of Articles 33(2) and (3) 
PCT. 

9) . Dependent claims 2 to 4 and 6 to 8 specify advantageous embodiments of the 
method according to claim 1 and the apparatus according to claim 5, respectively, and 
therefore also meet the requirements of Articles 33(2) and (3) PCT. 

Re Item VII 

Certain defects in the international application 

10) . Independent claims 1 and 5 are not in the two-part form in accordance with Rule 
6.3(b) PCT, which in the present case would be appropriate, with those features known 
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in combination from the prior art (document D2 ) being placed in the preamble (Rule 
6.3(b)(i) PCT) and with the remaining features being included in the characterising part 
(Rule 6.3(b)(ii) PCT). 

In the present case, the features enumerated in point (2) are known in combination 
from the document D2 and belong in the preamble of claims 1 and 5. 

11). 

The features of the claims are not provided with reference signs placed in parentheses 
(Rule 6.2(b) PCT). 
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